BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Localization events by Ev. Decom. - Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Localization 174 ( 86) 105 ( 86) 49.43 81.90 61.65
[VIBGhent ] Localization 174 ( 76) 97 ( 76) 43.68 78.35 56.09
[JULIELab ] Localization 174 ( 76) 98 ( 76) 43.68 77.55 55.88
[UT+DBCLS ] Localization 174 ( 66) 75 ( 66) 37.93 88.00 53.01
[ConcordU ] Localization 174 ( 62) 67 ( 62) 35.63 92.54 51.45
[ UNIMAN ] Localization 174 ( 78) 147 ( 78) 44.83 53.06 48.60
[ UTokyo ] Localization 174 ( 55) 58 ( 55) 31.61 94.83 47.41
[ UAveiro ] Localization 174 ( 62) 88 ( 62) 35.63 70.45 47.33
[ASU+HU+BU] Localization 174 ( 57) 70 ( 57) 32.76 81.43 46.72
[CNBMadrid] Localization 174 ( 61) 114 ( 61) 35.06 53.51 42.36
[ UMich ] Localization 174 ( 80) 212 ( 80) 45.98 37.74 41.45
[ SCAI ] Localization 174 ( 48) 58 ( 48) 27.59 82.76 41.38
[ Cam ] Localization 174 ( 45) 50 ( 45) 25.86 90.00 40.18
[ Team 24 ] Localization 174 ( 48) 80 ( 48) 27.59 60.00 37.80
[ UNSW ] Localization 174 ( 40) 41 ( 40) 22.99 97.56 37.21
[ NICTA ] Localization 174 ( 42) 66 ( 42) 24.14 63.64 35.00
[UAntwerp ] Localization 174 ( 36) 46 ( 36) 20.69 78.26 32.73
[ KoreaU ] Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
[CIPS-ASU ] Localization 174 ( 49) 143 ( 49) 28.16 34.27 30.91
[ UZurich ] Localization 174 ( 32) 34 ( 32) 18.39 94.12 30.77
[ PIKB ] Localization 174 ( 19) 23 ( 19) 10.92 82.61 19.29
[CCP-BTMG ] Localization 174 ( 18) 18 ( 18) 10.34 100.00 18.75
[ USzeged ] Localization 174 ( 14) 33 ( 14) 8.05 42.42 13.53
[ Team 09 ] Localization 174 ( 1) 1 ( 1) 0.57 100.00 1.14
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Localization 239 ( 81) 92 ( 81) 33.89 88.04 48.94
[CNBMadrid] Localization 239 ( 82) 158 ( 82) 34.31 51.90 41.31
[ASU+HU+BU] Localization 239 ( 57) 70 ( 57) 23.85 81.43 36.89
[ Team 24 ] Localization 239 ( 62) 101 ( 62) 25.94 61.39 36.47
[UAntwerp ] Localization 239 ( 37) 47 ( 37) 15.48 78.72 25.87
[CCP-BTMG ] Localization 239 ( 18) 18 ( 18) 7.53 100.00 14.01
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------